15 research outputs found
Learning Feedback Terms for Reactive Planning and Control
With the advancement of robotics, machine learning, and machine perception,
increasingly more robots will enter human environments to assist with daily
tasks. However, dynamically-changing human environments requires reactive
motion plans. Reactivity can be accomplished through replanning, e.g.
model-predictive control, or through a reactive feedback policy that modifies
on-going behavior in response to sensory events. In this paper, we investigate
how to use machine learning to add reactivity to a previously learned nominal
skilled behavior. We approach this by learning a reactive modification term for
movement plans represented by nonlinear differential equations. In particular,
we use dynamic movement primitives (DMPs) to represent a skill and a neural
network to learn a reactive policy from human demonstrations. We use the well
explored domain of obstacle avoidance for robot manipulation as a test bed. Our
approach demonstrates how a neural network can be combined with physical
insights to ensure robust behavior across different obstacle settings and
movement durations. Evaluations on an anthropomorphic robotic system
demonstrate the effectiveness of our work.Comment: 8 pages, accepted to be published at ICRA 2017 conferenc
Learning Sensor Feedback Models from Demonstrations via Phase-Modulated Neural Networks
In order to robustly execute a task under environmental uncertainty, a robot
needs to be able to reactively adapt to changes arising in its environment. The
environment changes are usually reflected in deviation from expected sensory
traces. These deviations in sensory traces can be used to drive the motion
adaptation, and for this purpose, a feedback model is required. The feedback
model maps the deviations in sensory traces to the motion plan adaptation. In
this paper, we develop a general data-driven framework for learning a feedback
model from demonstrations. We utilize a variant of a radial basis function
network structure --with movement phases as kernel centers-- which can
generally be applied to represent any feedback models for movement primitives.
To demonstrate the effectiveness of our framework, we test it on the task of
scraping on a tilt board. In this task, we are learning a reactive policy in
the form of orientation adaptation, based on deviations of tactile sensor
traces. As a proof of concept of our method, we provide evaluations on an
anthropomorphic robot. A video demonstrating our approach and its results can
be seen in https://youtu.be/7Dx5imy1KcwComment: 8 pages, accepted to be published at the International Conference on
Robotics and Automation (ICRA) 201
Learning Latent Space Dynamics for Tactile Servoing
To achieve a dexterous robotic manipulation, we need to endow our robot with
tactile feedback capability, i.e. the ability to drive action based on tactile
sensing. In this paper, we specifically address the challenge of tactile
servoing, i.e. given the current tactile sensing and a target/goal tactile
sensing --memorized from a successful task execution in the past-- what is the
action that will bring the current tactile sensing to move closer towards the
target tactile sensing at the next time step. We develop a data-driven approach
to acquire a dynamics model for tactile servoing by learning from
demonstration. Moreover, our method represents the tactile sensing information
as to lie on a surface --or a 2D manifold-- and perform a manifold learning,
making it applicable to any tactile skin geometry. We evaluate our method on a
contact point tracking task using a robot equipped with a tactile finger. A
video demonstrating our approach can be seen in https://youtu.be/0QK0-Vx7WkIComment: Accepted to be published at the International Conference on Robotics
and Automation (ICRA) 2019. The final version for publication at ICRA 2019 is
7 pages (i.e. 6 pages of technical content (including text, figures, tables,
acknowledgement, etc.) and 1 page of the Bibliography/References), while this
arXiv version is 8 pages (added Appendix and some extra details
Dietary patterns for adults with chronic kidney disease
This is the protocol for a review and there is no abstract. The objectives are as follows: This review will evaluate the benefits and harms of dietary patterns among adults with CKD (any stage including people with end-stage kidney disease (ESKD) treated with dialysis, transplantation or supportive care)
Dietary interventions for adults with chronic kidney disease
Background: Dietary changes are routinely recommended in people with chronic kidney disease (CKD) on the basis of randomised evidence in the general population and non-randomised studies in CKD that suggest certain healthy eating patterns may prevent cardiovascular events and lower mortality. People who have kidney disease have prioritised dietary modifications as an important treatment uncertainty. Objectives: This review evaluated the benefits and harms of dietary interventions among adults with CKD including people with end-stage kidney disease (ESKD) treated with dialysis or kidney transplantation. Search methods: We searched the Cochrane Kidney and Transplant Specialised Register (up to 31 January 2017) through contact with the Information Specialist using search terms relevant to this review. Studies contained in the Specialised Register are identified through search strategies specifically designed for CENTRAL, MEDLINE, and EMBASE; handsearching conference proceedings; and searching the International Clinical Trials Register (ICTRP) Search Portal and ClinicalTrials.gov. Selection criteria: Randomised controlled trials (RCTs) or quasi-randomised RCTs of dietary interventions versus other dietary interventions, lifestyle advice, or standard care assessing mortality, cardiovascular events, health-related quality of life, and biochemical, anthropomorphic, and nutritional outcomes among people with CKD. Data collection and analysis: Two authors independently screened studies for inclusion and extracted data. Results were summarised as risk ratios (RR) for dichotomous outcomes or mean differences (MD) or standardised MD (SMD) for continuous outcomes, with 95% confidence intervals (CI) or in descriptive format when meta-analysis was not possible. Confidence in the evidence was assessed using GRADE. Main results: We included 17 studies involving 1639 people with CKD. Three studies enrolled 341 people treated with dialysis, four studies enrolled 168 kidney transplant recipients, and 10 studies enrolled 1130 people with CKD stages 1 to 5. Eleven studies (900 people) evaluated dietary counselling with or without lifestyle advice and six evaluated dietary patterns (739 people), including one study (191 people) of a carbohydrate-restricted low-iron, polyphenol enriched diet, two studies (181 people) of increased fruit and vegetable intake, two studies (355 people) of a Mediterranean diet and one study (12 people) of a high protein/low carbohydrate diet. Risks of bias in the included studies were generally high or unclear, lowering confidence in the results. Participants were followed up for a median of 12 months (range 1 to 46.8 months). Studies were not designed to examine all-cause mortality or cardiovascular events. In very-low quality evidence, dietary interventions had uncertain effects on all-cause mortality or ESKD. In absolute terms, dietary interventions may prevent one person in every 3000 treated for one year avoiding ESKD, although the certainty in this effect was very low. Across all 17 studies, outcome data for cardiovascular events were sparse. Dietary interventions in low quality evidence were associated with a higher health-related quality of life (2 studies, 119 people: MD in SF-36 score 11.46, 95% CI 7.73 to 15.18; I = 0%). Adverse events were generally not reported. Dietary interventions lowered systolic blood pressure (3 studies, 167 people: MD -9.26 mm Hg, 95% CI -13.48 to -5.04; I = 80%) and diastolic blood pressure (2 studies, 95 people: MD -8.95, 95% CI -10.69 to -7.21; I = 0%) compared to a control diet. Dietary interventions were associated with a higher estimated glomerular filtration rate (eGFR) (5 studies, 219 people: SMD 1.08; 95% CI 0.26 to 1.97; I = 88%) and serum albumin levels (6 studies, 541 people: MD 0.16 g/dL, 95% CI 0.07 to 0.24; I = 26%). A Mediterranean diet lowered serum LDL cholesterol levels (1 study, 40 people: MD -1.00 mmol/L, 95% CI -1.56 to -0.44). Authors' conclusions: Dietary interventions have uncertain effects on mortality, cardiovascular events and ESKD among people with CKD as these outcomes were rarely measured or reported. Dietary interventions may increase health-related quality of life, eGFR, and serum albumin, and lower blood pressure and serum cholesterol levels. Based on stakeholder prioritisation of dietary research in the setting of CKD and preliminary evidence of beneficial effects on risks factors for clinical outcomes, large-scale pragmatic RCTs to test the effects of dietary interventions on patient outcomes are required
Supervised Learning and Reinforcement Learning of Feedback Models for Reactive Behaviors: Tactile Feedback Testbed
Robots need to be able to adapt to unexpected changes in the environment such
that they can autonomously succeed in their tasks. However, hand-designing
feedback models for adaptation is tedious, if at all possible, making
data-driven methods a promising alternative. In this paper we introduce a full
framework for learning feedback models for reactive motion planning. Our
pipeline starts by segmenting demonstrations of a complete task into motion
primitives via a semi-automated segmentation algorithm. Then, given additional
demonstrations of successful adaptation behaviors, we learn initial feedback
models through learning from demonstrations. In the final phase, a
sample-efficient reinforcement learning algorithm fine-tunes these feedback
models for novel task settings through few real system interactions. We
evaluate our approach on a real anthropomorphic robot in learning a tactile
feedback task.Comment: Submitted to the International Journal of Robotics Research. Paper
length is 21 pages (including references) with 12 figures. A video overview
of the reinforcement learning experiment on the real robot can be seen at
https://www.youtube.com/watch?v=WDq1rcupVM0. arXiv admin note: text overlap
with arXiv:1710.0855
Haematological consequences of acute uncomplicated falciparum malaria: a WorldWide Antimalarial Resistance Network pooled analysis of individual patient data
Background: Plasmodium falciparum malaria is associated with anaemia-related morbidity, attributable to host, parasite and drug factors. We quantified the haematological response following treatment of uncomplicated P. falciparum malaria to identify the factors associated with malarial anaemia.
Methods: Individual patient data from eligible antimalarial efficacy studies of uncomplicated P. falciparum malaria, available through the WorldWide Antimalarial Resistance Network data repository prior to August 2015, were pooled using standardised methodology. The haematological response over time was quantified using a multivariable linear mixed effects model with nonlinear terms for time, and the model was then used to estimate the mean haemoglobin at day of nadir and day 7. Multivariable logistic regression quantified risk factors for moderately severe anaemia (haemoglobin < 7 g/dL) at day 0, day 3 and day 7 as well as a fractional fall ≥ 25% at day 3 and day 7.
Results: A total of 70,226 patients, recruited into 200 studies between 1991 and 2013, were included in the analysis: 50,859 (72.4%) enrolled in Africa, 18,451 (26.3%) in Asia and 916 (1.3%) in South America. The median haemoglobin concentration at presentation was 9.9 g/dL (range 5.0–19.7 g/dL) in Africa, 11.6 g/dL (range 5.0–20.0 g/dL) in Asia and 12.3 g/dL (range 6.9–17.9 g/dL) in South America. Moderately severe anaemia (Hb < 7g/dl) was present in 8.4% (4284/50,859) of patients from Africa, 3.3% (606/18,451) from Asia and 0.1% (1/916) from South America. The nadir haemoglobin occurred on day 2 post treatment with a mean fall from baseline of 0.57 g/dL in Africa and 1.13 g/dL in Asia. Independent risk factors for moderately severe anaemia on day 7, in both Africa and Asia, included moderately severe anaemia at baseline (adjusted odds ratio (AOR) = 16.10 and AOR = 23.00, respectively), young age (age < 1 compared to ≥ 12 years AOR = 12.81 and AOR = 6.79, respectively), high parasitaemia (AOR = 1.78 and AOR = 1.58, respectively) and delayed parasite clearance (AOR = 2.44 and AOR = 2.59, respectively). In Asia, patients treated with an artemisinin-based regimen were at significantly greater risk of moderately severe anaemia on day 7 compared to those treated with a non-artemisinin-based regimen (AOR = 2.06 [95%CI 1.39–3.05], p < 0.001).
Conclusions: In patients with uncomplicated P. falciparum malaria, the nadir haemoglobin occurs 2 days after starting treatment. Although artemisinin-based treatments increase the rate of parasite clearance, in Asia they are associated with a greater risk of anaemia during recovery